arXiv:1505.05878vl [quant-ph] 21 May 2015 


Open system quantum annealing in mean field models with exponential degeneracy 

Kostyantyn Kechedzhi^ and Vadim N. Smelyanskiy^ 

^ QuAIL, NASA Ames Research Center, Mail Stop 269-3, Moffett Field, CA 94035 and 
USRA, NASA Ames Research Center, Moffett Field, CA 94035 
^Google, 150 Main St, Venice Beach, CA, 90291 

Real life quantum computers are inevitably affected by intrinsic noise resulting in dissipative 
non-unitary dynamics realized by these devices. We consider an open system quantum annealing 
algorithm optimized for a realistic analog quantum device which takes advantage of noise-induced 
thermalization and relies on incoherent quantum tunneling at finite temperature. We analyze the 
performance of this algorithm considering a p—spin model which allows for a mean field quasi- 
calssical solution and at the same time demonstrates the 1st order phase transition and exponential 
degeneracy of states. We demonstrate that finite temperature effects introduced by the noise are 
particularly important for the dynamics in presence of the exponential degeneracy of metastable 
states. We determine the optimal regime of the open system quantum annealing algorithm for this 
model and find that it can outperform simulated annealing in a range of parameters. 


I. INTRODUCTION 

Quantum computing hardware is affected by substan¬ 
tial level of intrinsic noise and therefore naturally real¬ 
izes dissipative quantum dynamics^’^. Optimization al¬ 
gorithms, where a configuration of a binary string x min¬ 
imizing a given (energy or cost) function f{x) is sought 
for, naturally extract computational advantage from the 
irreversible dissipative dynamics, and could therefore 
be readily implemented on a number of existing hard¬ 
ware platforms^More specifically, quantum annealing® 
(QA) is a quantum analog of the widely applied classical 
simulated annealing algorithm® (SA), a heuristic solver 
of NP-hard optimization problems®’^^^®, with quantum 
fluctuations playing the role analogous to thermal fluc¬ 
tuations in simulated annealing. NP-hard optimization 
problems such as finding a ground state spin configura¬ 
tion of a spin glass, are often characterized by an energy 
landscape with a large number of local minima separated 
by extensive energy barriers. Dissipative dynamics real¬ 
ized by the open system quantum annealing provides an 
efficient mechanism for thermalization within domains of 
attraction of local minima. For efficient search of the con¬ 
figuration space the barriers separating different domains 
of attraction have to be overcome which may proceed via 
thermal excitation or quantum tunneling process. The 
performance of the open system quantum annealing al¬ 
gorithm is therefore characterized by a set of relaxation 
rates associated with such processes, as opposed to, for 
example, the spectral gaps, as is the case for adiabatic 
quantum algorithm®’^^. 

The longest relaxation times correspond to the often 
exponentially slow transitions between local minima sep¬ 
arated by extensive potential barriers. Unitary dynamics 
of a pair of such states corresponds to the switching rate 
of the order of the matrix element A, which in presence 
of an extensive barrier may scale exponentially with the 
system size A oc exp(—const x N). Whereas fast dissipa¬ 
tive relaxation within a domain of attraction of a local 
minima due to the hardware noise introduces a lifetime 


or level width W. This fast local relaxation strongly 
suppresses the coherent superposition of the states lo¬ 
calized in different local minima when W ^ A. Never¬ 
theless, the incoherent quantum tunneling is possible in 
presence of such strong dissipation where the transition 
rate is described by the Fermi golden rule type expression 
oc A^ <C A. This is the regime likely realized in a large 
scale quantum annealer®. It is an open question whether 
such incoherent extensive quantum tunneling may pro¬ 
vide a more efficient mechanism for searching the config¬ 
uration space as compared to classical simulated anneal¬ 
ing relying on thermal excitation. 

In this paper, we analyze the performance of the open 
system quantum annealing algorithm optimized for the 
regime of the quantum dissipative dynamics, taking ad¬ 
vantage of thermalization and incoherent quantum tun¬ 
neling. Our goal here is to analyze the contribution of 
extensive quantum tunneling to the performance of the 
algorithm. We consider a model in which there exists a 
metastable state separated by an extensive barrier from 
the ground state. We consider a system of Ising spins 
interacting each with each other with p—body interac¬ 
tion of equal strength, a model often referred to as a 
p—spin model. This model allows for a quasiclassical 
WKB description®^’^®, where the expansion is performed 
in 1/A rather than the more usual h, and, at the same 
time, demonstrates key features characteristic of a range 
of complex (NP-hard) optimization problems, such as 
the 1st order phase transition (for p > 3) and exponen¬ 
tially small gap between the ground and excited state. 
Crucially, the metastable state realized in this model is 
characterized by an exponential degeneracy whereas the 
ground state is unique. Such entropic imbalance is in fact 
typical for low energy states in the spin glass phase and it 
strongly affects the low temperature system dynamics in 
both quantum and classical cases. The effect of entropic 
imbalance is the main focus of our analysis in this paper. 

We demonstrate that in presence of such extensive en¬ 
tropy imbalance SA computation time scales exponen¬ 
tially with the system size N. This can be understood 
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intuitively considering the performance of the simulated 
annealing applied to a model demonstrating a 1st order 
phase transition into a state characterized by an order 
parameter. Assume the ordered state to be a ferromag- 
net for simplicity. In simulated annealing the system 
is initialized at infinite temperature, or equal occupa¬ 
tion of all classical spin states, then the temperature is 
gradually lowered to zero. The simulated spin dynam¬ 
ics is chosen to satisfy the detailed balance condition 
such that it samples the thermal distribution at a given 
(instant) temperature. The initial state is a paramag- 
net, and therefore the solution, the ground state spin 
configuration at zero temperature, is expected to have 
high statistical weight only at low enough temperatures 
below the ferromagnetic phase transition. The expo¬ 
nential degeneracy of the metastable state corresponds 
to the entropy linear in the system size N which sig¬ 
nificantly lowers the transition temperature. This can 
be understood intuitively from the following argument. 
We assume a mean field case in which energies of the 
metastable and ground states as well as the barrier sep¬ 
arating them scale linearly with the system size NEmSj 
NEqs and NU, respectively. We find from equating the 
free energies NQms — NEms/T « —NEqs/T, where 
the entropy imbalance is given by NQmSj that the tran¬ 
sition occurs at T„ ~ Ems-Egs ^ 0(1). Furthermore, 
high statistical weight of the ground state is achieved 
only after equilibration at the low temperature below 
the phase transition T < Tc ~ 0(1). In presence of the 
extensive barrier NE the relaxation towards the ther¬ 
mal distribution described by the classical Krammers es¬ 
cape rate ~ exp {—NU/Tc) is exponentially slow. More¬ 
over, the entropy gradient along the over-the-barrier es¬ 
cape trajectory gives rise to an additional entropic fac¬ 
tor ~ exp{QMS — Qt), where Qt is the entropy corre¬ 
sponding to the top of the barrier, which appears as an 
exponential contribution to the prefactor of the Kram¬ 
mers rate^"^. Therefore the computation time allowing for 
such relaxation to occur is at least as long the relaxation 
time Tu ~ ex.p{NUQMs/{EMS — Eqs) + Qms — Qt)- 
In fact, a more careful analysis, see Appendix A, shows 
that the optimal SA computation time in the presence of 
the extensive entropy imbalance is given by the smallest 
of either t„ or the exhaustive search time Tes ~ 2^. At 
the same time quantum tunneling amplitude saturates 
as T —)■ 0 and may be more efficient than over the bar¬ 
rier escape suggesting that quantum annealing could be 
more efficient than simulated annealing. Note however 
that quantum tunneling rate in this mean field model 
will also scale exponentially with N. Therefore the per¬ 
formance of each algorithm will be characterized by a 
numerical factor in the exponent which have to be care¬ 
fully compared. The result is not obvious a priori since 
we are comparing here different microscopic mechanisms: 
the quantum dynamics constrained by conservation laws 
with the classical thermal excitation process constrained 
by the entropy imbalance and the low temperature. 

Considering the open system quantum annealing ap¬ 


plied to the p-spin model we show that the scaling of 
the optimal QA computation time (allowing for repeated 
runs of the algorithm) is determined by the quantum tun¬ 
neling amplitude at a single point in the algorithm, the so 
called freezing point, after which quantum/thermal fluc¬ 
tuations are weak and the transitions over or through the 
barrier are no longer likely. We find that due to the ef¬ 
fect of the entropy associated with the metastable state 
the optimal quantum tunneling rate is achieved at van¬ 
ishing temperature, i.e. raising temperature may reduce 
the quantum tunneling rate. This is in contrast with 
the usual intuition about a quantum mechanical particle 
trapped in a non-degenerate metastable potential well 
where the escape rate monotonously increases with tem¬ 
perature. The optimal QA regime therefore also corre¬ 
sponds to the vanishing temperature. Comparing the 
optimal computation time of QA obtained in this regime 
with that of SA for a range of the potential barrier shapes 
we find that QA could outperform SA under certain cir¬ 
cumstances, thus providing a polynomial (rather than 
exponential) speedup. 

The remainder of the paper is organized as follows. 
In Sec. II we introduce the p-spin model and its WKB 
analysis describing the evolution of the potential energy 
and the transition rates in the course of the quantum 
annealing algorithm. In Sec. Ill we discuss the dynamics 
of the model in the course of the quantum annealing and 
identify the freezing point and its optimal position in the 
course of the algorithm. We conclude with a discussion 
of the results in Sec. IV. 


II. THE MODEL 

We consider N Ising spins 1/2 on a fully connected 
graph (i.e. each spin interacts with each other spin) with 
uniform interaction strength such that the system is fully 
described in terms of the total spin projection operator 
S°‘ = where a = x,y,z and (t“ is a set of 

spin—1/2 operators. We consider a Hamiltonian, 

n = sNf(^p^'^-{l-s)S^, ( 1 ) 

consisting of a uniform transverse field term, the second 
term above, and a potential energy of interaction f{x), 
which is assumed to be a function of the z—projection 
operator. The potential energy of a p-spin interaction 
of unit strength H = corresponds to 

f{x) = xP. Without loss of generality we choose both 
of the terms in the Hamiltonian Eq. (1) to scale linearly 
with N. The parameter s in Eq. (1) controls the relative 
strength of the potential energy and the transverse field 
and changes from s = 0 to s = 1 in the course of the 
quantum annealing algorithm. 

Of specific interest is the case of p = 3. Models with 
p > 3 can be solved in polynomial time by avoiding the 
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1st order phase transition using advanced driver Hamil¬ 
tonian, 6—spin (5 > 2) interactions inducing transverse 
(XY) ferro- or antiferromagnetism, in addition to the 
standard transverse field term^^“^^. In this case arriv¬ 
ing at the ground state at the end of the QA evolution 
does not require extensive quantum tunneling through a 
barrier. Therefore a classical model algorithm such as 
“spin-vector” Monte Carlo method^®, which could follow 
the deformation of the effective quasiclassical potential 
imitating the course of QA, is also not expected to en¬ 
counter a bottleneck requiring exponential computation 
time. Whereas in the case of p = 3 the 1st order phase 
transition cannot be avoided in this way, as a result an ex¬ 
ponentially weak tunneling process is critical for finding 
the ground state in this system. The quantum tunnel¬ 
ing regime in this case cannot be described by a classical 
model. While adiabatic quantum computation was ana¬ 
lyzed in the p-spin model^®’^°, we will focus here on the 
open system quantum annealing in presence of dissipa¬ 
tion and non-zero temperature which is the case more 
suitable for implementation on current analog quantum 
annealers. 

The Hamiltonian Eq. (1) commutes with = (;S“)^-|- 
(S'^)^ -I- which is therefore a conserved quantity. In 

the basis of states, \S,M) : S^\S,M) = S{S+l)\S,M), 
with definite total spin S and its projection on z-axis 
M = {—S',..., S'} the matrix elements of the Hamiltonian 
Eq. (1) are given by the standard spin—S rules, 

S^\S,M) = M\S,M) (2) 

S±|S,M) = v/S(S-kl)-M(M±l)|S,M±l) (3) 

where we introduced raising and lowering operators, 
S^ = |(S“ ± iS^). We introduce an integer parame¬ 
ter K = 0,1,..., to label the total spin eigenstates 
S = ^ — K, each value corresponding to a completely 
disconnected subspace of the eigenspace of Eq. (1), which 
will however be connected due to the coupling to a ther¬ 
mal bath. The Hamiltonian Eq. (1) is symmetric with 
respect to exchanges of pairs of spins tfi 0 aj, and in 
fact with respect to all permutations of spins, since such 
operations do not change the sum over all spins 5“. This 
symmetry introduces a high degeneracy of eigenstates de¬ 
pending on their total spin S. The subspace with the 
maximal total spin S' = or if = 0 contains 2S -I- 1 
non-degenerate states (there are no non-trivial permu¬ 
tations) corresponding to all possible projections of the 
total spin on z—axis. At the same time the states with 
if 7 ^ 0 are highly degenerate, with the degeneracy being 
determined by the representations of the group of per¬ 
mutations. The eigenstate with a total spin labeled by 
if has the degeneracy {k)-{ ic-i) ~ exp i^Qk), where 
* = f = f ^ Lf J } > corresponds to 

the entropy term, 

In N 

Qk ~ -k\nk - {1 - k) ln(l - fc) -|- 


that has to be added to the free energy of a state with a 
given energy E and total spin parameter k, E = PE+Qk- 
In this paper we are interested in a cubic potential 
energy, 

^ f ^2 / 3(7 max Qmin \ / a\ 

/(g) =-c((?-Ig - - - 1 , (4) 

where q = q = {—(I — 2k), ..., (I — 2k)}. Eq. (4) 

is the most general cubic function with the metastable 
minimum at qmin and the potential barrier top at qmax, 
where f{qmin) > /(I) ensures that q = 1 is the global 
minimum. Without loss of generality we can put c = 1, 
the only effect of c 1 is to rescale the parameter s in 
Eq. (1). 

The dynamics of the total spin can be described using 
a systematic quasiclassical WKB expansion^^. In a spin 
model this expansion is performed in terms of the small 
parameter e = 2/N 1 which is an analog of h in the 

textbook WKB approach^^. We consider a wave function 
in the form, 

and expand it, $(< 7 ) « $ 0 -l-e$i+ O (e^). We can 
further expand the coefficients 4*^ for a small shift of the 
argument from q to q ± e, 

^M±i = (1 + if $0 ± ie$i) 

where O = ^. Substituting this expansion into the 
Schroedinger equation we obtain, 

'HT(( 7 ) « e(q)'i>(q), 

where in the main order in £ the Hamiltonian is diagonal 
and reads, 

e( 9 ) « sf(q) - f (1 - s)y(l - 2k)^ - q^cos^o- (5) 

Note that the function p = $0 is precisely the canonical 
momentum conjugate of the coordinate q, p ^ -i-^. In 
other words the second term above is a quantum kinetic 
energy which for p 1 corresponds to a particle with a 
position dependent mass m~^ = f (1 —s)-\/(l — 2k)'^ — q^ 
moving in an effective classical potential, 

U{k,q) = sfiq) - ^(1 - s)\/(l - 2fc)2 - gA ( 5 ) 

Note that the mass of the effective quantum particle is 
position dependent, it increases with increasing q and di¬ 
verges as (7 —> 1 which affects the efficiency of quantum 



4 



Figure 1. Effective classical potential is shown for s = 0, pure 
transverse field case (left), s = sqpt ~ 0.698, the zero tem¬ 
perature quantum phase transition point (center), and s = 1, 
pure classical potential (right). Different lines (bottom to top 
on all plots) correspond to different values of A: = 0, ...,0.5 
with equal intervals. Note that in the absence of the trans¬ 
verse held the states with different values of k are degenerate. 
Here Qmir, = 0 and q^ax « 0.467. 


tunneling into the states near q = 1. The effective poten¬ 
tial Eq. (6) for different values of s is shown in Fig. 1. In 
the course of the QA algorithm s = 0 —f s = 1 the effec¬ 
tive potential deforms from a squareroot parabola corre¬ 
sponding to the ground state (g, k) = (0,0) with the max¬ 
imal spin polarization along the transverse field direction 
at s —>■ 0, see left panel in Fig 1, and the classical poten¬ 
tial corresponding to the ground state (g, k) = (1,0) fully 
polarized along the axis of quantization s —>■ 1. Note the 
initial and final states of the algorithm are characterized 
by exponentially small overlap, see Appendix B. 

States with small kinetic energy are confined to one 
of the potential wells, centered around the two min¬ 
ima of the effective potential U{k,q), 

which in the course of the evolution as s —>■ 1 approach 
the metastable q^^}^ qmin and ground state -f 1 
of the classical model, respectively. Confinement of the 
states is determined by the condition of vanishing classi¬ 
cal velocity, v{k, q, E) = ^ = 0, which gives. 


-1 < 2 


sf{q) - E 


(1 - s ) a /(1 - 2 fc )2 - g 2 


< 1 . 


( 7 ) 


The solution of this equation gives the location of the 
turning points q^jlp{k,E) and qpp(k,E) which limit the 
classically allowed region. Inverting the secular equation, 
Eq. (5) for a given energy E we write the wave function 
in the main order in e, 


~ exp 



( 8 ) 


with 


p = arccos2- 


sf{q) - E 


'(l-s)V(l-2fc)2-g2’ 

when the condition Eq. (7) is satisfied, and 


( 9 ) 


p = farccosh2 


sf{q)-E 


(1 - s)y/{l-2kY - q^' 


( 10 ) 


otherwise. The latter expression corresponds to the ex¬ 
ponentially decaying tail of the wave function extending 
beyond the classically allowed region into the potential 
barrier. 

In the course of the evolution, s : 0 —>■ 1, there 
is a point of zero temperature discontinuous quantum 
phase transition, s = sqpt, at which the minimal en¬ 
ergies in the two wells, left at g ~ qmin and right 
Ep at g ~ 1, are equal to each other. In the course 
of the QA algorithm at finite temperature this transi¬ 
tion occurs at a different transverse field strength s = 
spt{P) > SQPT- The phase transition point can be 
found from the condition of equal occupation of the two 
potential wells Vp = Vr including the entropy of the 
states. In the large N limit and at low temperatures 
/3 ^ 0{N^) we can approximate the occupation number 
= E E,k exp - log Z) « exp {-Ep - log Z) by a 
single dominant term corresponding to a minimum of the 
free energy. We write the local minimum condition in a 
potential well as ^ = 0 to obtain. 


dE _ dQk _ , k 
dk dk 1 — k 


( 11 ) 


This determines the kmin corresponding to the minimum 
of the free energy. Whereas the optimal energy (princi¬ 
pal quantum number) with a given k corresponds to the 
minimum of the potential U{kmin,q)- We neglect the 
quantization of levels due to finite N for the purpose of 
this calculation. At s > spriP) the left potential well 
is separated from the ground state by a potential barrier 
with the shape determined by the parameters qmin and 
qmax and overall scaling ~ N. At low temperatures the 
relaxation in this model is therefore determined by the 
rate of transitions between the wells. 

In a closed quantum system in the absence of the ther¬ 
mal bath multiple tunneling effects between the wells 
need to be taken into account which corresponds to the 
ground state formed by a coherent superposition of the 
states in the two potential wells, i.e. a Schroedinger cat 
state. In a large system the level splitting A correspond¬ 
ing to such superposition is exponentially small (in the 
system size N), and therefore such coherent dynamics is 
quickly suppressed by small perturbations, such as the 
hardware noise. This results in overdamped dynamics 
characterized by fast intra-well relaxation towards ther¬ 
mal occupation^^ reflected in the level width W ^ A 
and exponentially rare incoherent tunneling effects with 
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the rate ~ A^. On the other hand we neglect the effect 
of noise on the tunneling event itself since tunneling is 
a fast process occurring on the timescale 1 /w, where w 
is the frequency determined by the curvature of the po¬ 
tential. We assume therefore that oo ^ W ^ A. We 
are interested only in the exponential scaling of the tran¬ 
sition rates in this paper ignoring the renormalization 
of the preexponential factor that may be substantial in 
the regime of strong coupling to the environment. Note 
that the overdamped dynamics and thermalization are 
expected even in the absence of the coupling to a ther¬ 
mal bath, it can be introduced by a weak disorder in 
the spin-spin interactions SH — or oven weak 

random transverse field^^. 

In the regime of the overdamped dynamics at s < 
spt{P) the ground state corresponds to q = qlj^inis). As 
the system goes past the phase transition with growing 
s > spt{/3) this state becomes metastable. The average 
transition rate w <^W across the barrier in presence of 
fast the intra-well relaxation W can be obtained by calcu¬ 
lating the total current escaping the metastable welP^’^^, 


w (X ^ ^ if)e (12) 

k,E 

Eq. (12) is a thermal average, weighted with the usual 
Boltzmann factor including the entropy Qk, of 

w{k,E) ~ Q-SwKB{k,E) ^ incoherent tunneling ampli¬ 
tude through the barrier of a state with a given energy E 
and total spin parameter k. The so called reduced action 
SwKsik, E) can be obtained by matching the quasiclas- 
sical wave functions across the barrier region or following 
the analytical continuation procedure^^. 


SwKB{k, E) = -2 dqp{q) 


= —N dgarccosh 


2isfiq)-E) 


The sum Eq. (12) can be approximated by its largest 
term, the rest being exponentially smaller. 


w ^ ^''^w{k, E)e dE+Qk ^ ^ Sapt_ ( 2 ^ 3 ^ 

k,E 

Where the largest term is found by minimizng the action, 
Sopt = SwKB + PE — Qk + \nZ (14) 

with respect to k and E, 

T{E) = -^^f^=P (15) 

(16) 


where in Eq. (15) fixed k is assumed. Since Qk is in¬ 
dependent of the energy level E the conditions on the 
optimal tunneling parameters separate into the standard 
condition Eq. (15) requiring the period of motion in the 
inverted potential T{E) to match the inverse tempera¬ 
ture and the condition Eq. (16) due to the entropy of 
states dependent on k, which introduces novel physics in 
the dynamics of this model. Eqs. (14, 15, 16) need to be 
supplemented with conditions ensuring that the energy 
and total spin k are conserved in the tunneling event (we 
emphasize that we neglect here the effect of the thermal 
bath during the tunneling event). The tunneling from 
the metastable well has to be at an energy and spin val¬ 
ues, E and k, at which a state exists in the ground state 
well, i.e. E > min{if/j(fc)}, which is not always satisfied 
in the system with large entropy of states, i.e. El < Ep 
does not necessarily imply Ep < Ep. 

Eq. (15) has a solution in a range of energies E such 
that Tjnin < T{E) < oo, see inset in Fig. 2 left. In the 
case of /? > Tjnin the quantum tunneling process domi¬ 
nates in the sum in Eq. (13). For /? < T^m there are no 
solutions to Eq. (15) and therefore the optimal energy is 
at the edge of the interval E = U(qmax) — U{qmin) cor¬ 
responding to the height of the barrier. In other words, 
in this regime over-the-barrier escape process dominates 
with P ~ Train being the point of a quantum-to-classical 
phase transition. Note that the global minimum Emin of 
the function T{E) in the inset in Fig. 2 does not always 
correspond to the top of the barrier, which means that 
the quantum to classical transition (in the limit N —)■ oo) 
has a discontinuous 1st order character^^. Considering 
Eq. (16) we look for a solution in the interval t) < k < k^ 
where fc* is the inflection point of the potential U{q,k) 
where the right (the ground state) potential well disap¬ 
pears, see Fig. 1, since quantum tunneling conserves the 
total spin k, for it to occur there must exist states with 
matching k in the ground state potential well. 

The result of this optimization procedure is the opti¬ 
mal action Sopt{P) at a fixed s shown in Fig. 2 . In the 
vanishing temperature limit /3 —)■ oo, where the effect of 
entropy on the occupation of levels is negligible, Sgpt (P) 
corresponds to the quantum tunneling from the lowest 
energy level in the metastable well corresponding to k = 0 
(horizontal dashed line in Fig. 2 left). As temperature 
increases (/? decreases) the entropy starts playing a role 
in dynamics and Sopt{P) increases up to some maximum 
value, see blue solid line in Fig. 2 left, in contrast with 
the usual (non-degenerate) case^^ where quantum tun¬ 
neling rate increases with increasing temperature P~^. 
This is a result of the entropy providing a high statisti¬ 
cal weight to the state with suboptimal tunneling rate. 
This behavior is not entirely generic and originates in the 
model of Eqs. (1) and (4) because the transverse field 
lifts the degeneracy of the metastable state favoring the 
non-degenerate state with k = 0, see Fig. 1. Whereas 
the entropy favors the state with fc = 1/2 (at /3 —>■ 0 ) 
and therefore with increasing temperature the state with 
the highest statistical weight will correspond to a finite 
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1/2 > fc > 0, given by the solution of Eq. (11). At 
the same time the potential barrier increases with k and 
therefore the quantum tunneling becomes less and less 
efficient, resulting in increasing SoptiP) with decreasing 
P up to the regime of the transition into the classical 
escape at high temperatures /3 <C Tmin- The classical 
over-the-barrier excitation is described by the thermal 
excitation rate Wd ~ Z~^ exp{—PE + Qk)- Note that 
the classical process is driven by the Glauber dynamics 
of the spins due to the effect of the thermal bath. This 
process does not conserve the total spin k and therefore 
the optimal classical trajectory is determined by the sad¬ 
dle point of the free energy (including the entropy) in 
the 2D space of {k,q). Entropy provides an additional 
cost reducing the transition rate which is reflected in the 
finite offset of the dependence of the classical transition 
rate on /3 as /? —)■ 0, see black solid line in Fig. 2 Left, 
see Appendix A for more details. Blue and red dashed 
lines in Fig. 2 indicate the linear in /3 dependence of the 
energy cost of the over the barrier excitation at fc = 0 
and along the line of g = 1 — 2 fc with the potential max¬ 
imum at fc « fc* (the latter is the inflection point of the 
potential U(k,q)), respectively, which correspond to the 
low temperature potential energy dominated regime and 
the high temperature entropy dominated regime^®. 

The steepest descent approximation Eq. (13) is appli¬ 
cable as long as the preexponential factors in the sum are 
non-divergent which is true away from /3 ~ Tmin a phase 
transition point from the quantum tunneling regime to 
the classical over-the-barrier escape regime^®. On gen¬ 
eral grounds we expect the action to be continuous even 
in the case where this quantum-to-classical transition is 
of the 1 st order, with the discontinuity occurring in the 
derivative of the action^^. Therefore we expect Fig. 2 to 
provide a qualitatively correct dependence of S'(/3) in the 
whole range of inverse temperatures /3. 

III. QUANTUM ANNEALING COMPUTATION 
TIME 

In the course of the QA algorithm the transverse field 
parameter s is varied from s = 0 to s = 1 with a fixed rate 
n at a fixed inverse temperature /3. The goal is to find the 
ground state with probability approaching ^ 1 , allowing 
for repeated runs of the algorithm. Here we assume that 
finding any state within the ground state potential well 
is sufficient to find the solution (as local search could al¬ 
low identifying the lowest energy state within the well). 
Given the probability Vcs of finding the ground state 
after a single run of duration the number of runs 
needed to achieve this goal is Vq^. The total computa¬ 
tion time is therefore given by, 

T - X Val- 

The quantum mechanical tunneling rate vanishes as s —>■ 
1 (at very low temperatures of interest here the over- 



Figure 2. Tunneling action as a function of inverse tempera¬ 
ture p. For qmin = 0, q^ax = 0.533 at s = 0.85 > sqpt- Left: 
Black dots, and the solid blue line fit, correspond to optimal 
finite temperature quantum tunneling action. Horizontal dot¬ 
ted line is the /3 —>■ oo limit of the incoherent tunneling action 
corresponding to the quantum mechanical tunneling from the 
lowest level of the metastable well corresponding to fc = 0. 
Solid black line corresponds to the optimal action of the clas¬ 
sical Glauber dynamics. Blue and red dashed lines show the 
classical over-the-barrier escape action at fc = 0 and along the 
line g = 1 — 2fc with the potential maximum at fc* « 0.152, 
respectively. The latter, fc*, is the point of inflection, i.e. the 
point where the minimum of the right potential well merges 
with the maximum at the barrier top, see Fig. 1. Vertical 
dashed line corresponds to the temperature driven phase tran¬ 
sition point Ppt ~ 4.32 corresponding to equal occupation of 
the two potential wells. Inset: T{E) — —dS/dE at hxed fc 
which corresponds to the period of quantum mechanical tun¬ 
neling trajectory in the imaginary time representation. Dom¬ 
inant contribution comes from tunneling at the energy de¬ 
termined from T{E) = P ior P > Tmin, at /3 < Tmin the 
transition rate is dominated by the over-the-barrier escape. 
Different lines bottom to top correspond to different values of 
s at fixed fc = 0. Red dots correspond to Tmin- Note that the 
minimum Emin '■ T{Emin) = Tmin does not correspond to 
the highest tunneling energy. This means that the transition 
from quantum tunneling regime to over-the-barrier escape has 
discontinuous 1st order character. Right: Quantum-classical 
transition region on a larger scale. Black dots correspond 
to tunneling action. Different lines show quantum mechani¬ 
cal tunneling action for fixed fc, colors correspond to growing 
0 < fc < 0.152 (red to blue). Quantum tunneling process 
conserves energy and total spin value fc. At k > kpR the 
point where EpikpR) = ERpkpR) quantum mechanical tun¬ 
neling process requires the state in the metastable well to 
be at an energy E > ER{k) which comes with an additional 
thermal excitation cost P [Epik) — Epik)) in the tunneling 
action. Therefore for growing fc the tunneling action S{P) re¬ 
sembles linear classical dependence. Solid black and dashed 
red and blue lines are the same as in the left hgure. 


the-barrier transition rate is also weak). Therefore there 
exists a point s = sf in the course of the sweep of the 
transverse field where the relaxation time ~ re¬ 

quired to achieve thermal distribution becomes longer 
than the length of the algorithm, ~ v~^. In 

other words the computation will be finished before the 
thermal equilibrium is reached. The system effectively 
freezes the values of the occupation numbers of the left 
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Vl and right Vr wells at the last point (in the course 
of the algorithm) where the inter-well transition process 
was still fast enough (the intra-well relaxation may still 
be efficient at s > sr). We call this the freezing point. 
The computation time of the algorithm (its exponential 
scaling) is therefore determined by the occupation proba¬ 
bility Vgs = 'PfiisF), and the equilibration time w~^(sf) 
at the freezing point, 






1 + e 




)]’ 


where Sopt is given by Eq. (14), with s = sr. The optimal 
computation time of the quantum annealing is found by 
minimizing with respect to the location of sr and the 
temperature /? at which the computation is performed. 
The point of the phase transition, P = Prr and sr = 
spT, respectively, defined by, J-r — J-r = 0 separates two 
scaling regimes of the computation time. 


c Sopt'S ^R ) P ^ Ppt{^') n si 

^ [ Sopu P > Ppt{s) ^ 

The high temperature limit of this expression is given 
by the entropy difference between the two wells. This 
is the limit of local exhaustive search. This is always a 
bound on the computation time of the algorithm with 
which we need to compare for completeness. We first 
consider P < Ppp assuming the free energy of the system 
demonstrates two minima J^r and Tr. In the quantum 
tunneling regime both Sopt{P) and JFr—Tr decrease with 
growing P and therefore ^{P) is monotonously decreasing 
as well. In the classical regime Sopt + ^r — Tr is, also 
a monotonous function which depending on competition 
between Sopt{P) and Fr — Tr can be either increasing, 
in which case /3 —>■ 0 is the optimal classical computa¬ 
tion regime (i.e. the local exhaustive search limit), or 
decreasing towards the critical point P = Ppt- There¬ 
fore we need to analyze the performance in the regime 
P > Ppt and s > spp and compare it to local exhaustive 
search. The optimal computation time in this regime, see 
Eq. (18), is determined by the minimum of the transition 
rate Sopt with respect to P and s. 

Because of the concave dependence of SoptiP) on the 
inverse temperature, as shown in Fig. 2 left, the minimum 
of the action with respect to P corresponds to one of 
the edges of the inverse temperature interval, i.e. either 
P = Ppt or /3 —>■ oo . The global minimum is therefore the 
smallest of S{Ppt{sf), sr) and S{oo, sr). The minimum 
with respect to sr (and therefore the global minimum) 
is determined by comparing these two functions. 

A typical critical line is shown in the left panel of Fig. 3. 
The inverse critical temperature Ppt{s), blue solid line 
in Fig. 3 left, diverges at the point of the quantum phase 
transition in the course of the algorithm, s = sqpt (verti¬ 
cal dashed line in Fig. 3), and at s > sqpt monotonously 
decreases with s approaching the classical transition tem¬ 
perature at s = 1 (horizontal dashed line in Fig. 3). The 




Figure 3. Left: Inverse critical temperature dependence on 
transverse field strength Ppt{s) for qmin = 0.88, qmax = 
0.955. The horizontal dashed line corresponds to the classi¬ 
cal transition temperature and the vertical dashed line marks 
the point of the quantum phase transition. Right: Blue line 
shows optimal over-the-barrier escape action along the crit¬ 
ical line shown in the left panel. Blue points correspond to 
the same values of s as in the left figure. Horizontal blue fine 
corresponds to the transition rate at the critical temperature 
in the classical model, s = 1. Vertical line corresponds to 
the point of zero temperature quantum phase transition. Red 
line corresponds to the vanishing temperature limit of the 
quantum tunneling action. Red horizontal dashed line cor¬ 
responds to the minimum of the quantum tunneling action 
at the quantum phase transition point. The local exhaustive 
search corresponds to ^ = ;^logres = Qdiqmin) ~ 0.227, 
larger than the quantum annealing time. 




Figure 4. Left: Quantum mechanical tunneling action at van¬ 
ishing temperature in the incoherent regime as a function of 
the transverse field parameter s. Different curves correspond 
to different values of qmax = 0.929, 0.946, 0.958, 0.961 with 
fixed qmin ~ 0.9. Note that the optimal tunneling rate em¬ 
phasized by horizontal dashed lines does not always corre¬ 
spond to the phase transition point denoted by vertical dashed 
lines. In other words the optimal QA schedule in the presence 
of dissipation is crucially different from QA in an isolated sys¬ 
tem. Right: Optimal action for SA (blue) and QA (red) at 
qmin = 0.88 for different values of qmax- The vertical dashed 
lines corresponds to qmin = ^qmax at which point the classi¬ 
cal potential has a degenerate ground state at g = qmin and 
q = 1. At this point both SA action and QA action diverge, 
however QA action diverges logarithmically slow in contrast 
to SA action. For the parameters chosen the local exhaustive 
search corresponds to ^ = ^ log Tea = Qci{qmin) ~ 0.227. 
























right panel of Fig. 3 shows the optimal over-the-barrier 
escape action at the given critical temperature Ppt{s), 
blue (upper) solid line. The blue dots in the left and right 
panels correspond to the same values of s. The classi¬ 
cal action, following the behavior of the inverse critical 
temperature diverges at the point of the quantum phase 
transition s = sqpt and decreases with s in the course 
of the algorithm approaching the value corresponding to 
the classical model s = 1, shown as the blue (upper) 
dashed line. The latter is the optimum (due to the high¬ 
est critical temperature) and therefore defines the opti¬ 
mal computation time of the classical simulated anneal¬ 
ing algorithm, see Appendix for a more details. The op¬ 
timum of the quantum action, at vanishing temperature, 
/3 —)■ 00 , is given by the tunneling from the bottom of the 
metastable well. In this limit the entropy does not affect 
the occupation of the energy levels in the course of the 
algorithm. We assume that the temperature is still high 
enough such that there is sufficiently fast intra-well re¬ 
laxation. Fig. 3 right shows Soptioo, s), red (lower) solid 
line, which assumes the minimal value at the quantum 
phase transition point s = sqpp. Note that this is not 
true for all the parameter values, instead the minimum of 
Sopt{oo,s) often occurs at some s > sqpt and its value 
at this point can be as much as two times smaller than 
the value at s = sqpt, see Fig. 4 left. It is possible to 
take advantage of this global minimum only in the course 
of the open system Quantum Annealing since the tran¬ 
sition corresponding to this rate maximum occurs not 
into the ground state level but into one of the excited 
states. Therefore such a transition should necessarily be 
followed by relaxation within the local domain of attrac¬ 
tion. Such local relaxation is not available in the closed 
system adiabatic quantum annealing algorithm. 

Fig. 3 right demonstrates that the quantum tunnel¬ 
ing process may be more efficient than over-the-barrier 
escape. Both classical and quantum transition rates, 
and therefore the corresponding computation times, scale 
exponentially with the system size, r oc exp(Q;7V), yet 
the coefficient in the exponent is smaller in the case 
of QA as compared to the classical simulated anneal¬ 
ing, which corresponds to a polynomial speedup. Note 
that it is important to compare the computation times 
in Fig. 3 with that of the local exhaustive in the inter¬ 
val {qmim 1)) which is the high temperature limit of SA. 
The corresponding computation time is given by the en¬ 
tropy ^ = Qcii^min), which for parameters considered 
in Fig. 3, (5ci(0.88) « 0.227, is above the QA value. We 
further compare the optimal performance of the open sys¬ 
tem quantum annealing Soptioo,s) to simulated anneal¬ 
ing for a wide range of barrier shapes within the cubic 
model Eq. (4) by varying the location of the metastable 
minimum q-min E^nd the barrier top qmax in Eq- (4), see 
left panel in Fig. 4 and Fig. 5. QA outperforms SA in a 
range of the parameter space where the potential barrier 
separating the metastable and the ground states is small. 
Note that the origin of the speedup in the case consid¬ 
ered here is distinct from the standard intuition of thin 



Figure 5. Left: Potential barrier between the metastable and 
the ground state Eq. (4) corresponding to s = 1 for two 
pairs of values {qmin,qmax) equal to (0, 0.633) (upper plot), 
(0.88, 0.955) (lower plot). Right: Transition action at the op¬ 
timal freezing point for QA (red) and SA (blue) as a function 
the location of metastable state qmin and the top of the bar¬ 
rier qmax- The lower of the two surfaces corresponds to the 
shorter computation time. QA is advantageous for a range 
of parameters corresponding to a sufficiently narrow poten¬ 
tial barriers. Solid lines in the plane 5 = 0 correspond to 
Qmin = qmax and qmin = \qmax Outlining the range of possi¬ 
ble potentials in the cubic model Eq. (4). 


and tall barriers favoring quantum tunneling, since the 
shape of the potential is cubic throughout the range of 
parameters shown in Fig. 5. Instead the quantum algo¬ 
rithm turns out to be more efficient because it proceeds 
along a path with lower entropic cost than the path that 
SA takes. This is a result of the transverse field lifting 
the degeneracy of the metastable state in the quantum 
case. Therefore the smallness of the barrier required for 
the speedup in this case is determined by the compari¬ 
son of the quantum tunneling action and the SA action 
including entropy cost of over-the-barrier escape. The 
latter being a combination of fippU and the additional 
entropic cost Qdiqmin) - Qdiqmax), see Appendix A for 
details. Note also that the numerical value of the ratio 
of the logarithms of the normalized computation times 
^ ^ logT for QA and SA can be substantial, see Fig. 4 

right. 


IV. DISCUSSION 

In this paper we considered a model problem for Quan¬ 
tum Annealing that allows analytical investigation and at 
the same time demonstrates some key features of complex 
optimization problems, including the discontinuous first 
order phase transition and the exponential degeneracy of 
the metastable state. We demonstrate that for problems 
with extensive degeneracy SA algorithm relies on over- 
the-barrier escape at very low temperature /3 ~ 0(1) as 
a result the SA computation time is exponential in N. 
At the same time we show that a computational advan¬ 
tage can be gained using open system quantum annealing 
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which exploits the effects of thermally assisted tunneling 
and quantum relaxation. The tunneling occurs between 
the excited states while the relaxation within the ground 
state’s domain of attraction brings the system down to 
the lowest energy state at the end of the quantum anneal¬ 
ing. Our analysis demonstrates novel and counter intu¬ 
itive features in the quantum tunneling process caused 
by the entropy of the metastable states, particularly, the 
tunneling rate decreasing with increasing temperature. 
As a consequence we find that the optimal quantum an¬ 
nealing regime corresponds to vanishing temperature, i.e. 
raising the temperature reduces the efficiency of QA. We 
also find that at low temperatures the optimal quantum 
tunneling rate does not always correspond to the point of 
the phase transition sqpt, in fact tunneling at s > sqpt 
can have a substantially higher rate, which can be ex¬ 
ploited in conjunction with noise-induced thermalization 
to improve the performance of the algorithm. We find 
that the comparison of the quantum annealing and sim¬ 
ulated annealing comes down to the numerical coefficient 
in the scaling of the computation time with N, which is 
determined by the functional form of the potential bar¬ 
rier. We demonstrate that optimal QA could outperform 
SA in a certain parameter range of our model charac¬ 
terized by small potential barriers. This is in spite of 
the constrained nature of the quantum tunneling pro¬ 
cess due to the conservation laws, as opposed to the un¬ 
constrained classical Glauber dynamics of SA. We iden¬ 
tify an additional advantage the quantum algorithm has 
over SA, which is the splitting of the degeneracy of the 
metastable state by the transverse field, which means 
the quantum algorithm proceeds along a trajectory with 
lower entropic cost as compared to SA, which is the re¬ 
sult of the shape of the effective potential. This suggests 
a speculation that optimization problems in which en¬ 


tropy is a dominant factor, yet at the same time, which 
are characterized by a potential energy landscape that 
can be exploited for more efficient search (as opposed to 
Grover’s unstructured search problem^^) may represent 
a class of problems where quantum annealing could have 
a computational advantage over simulated annealing. 

We also identify key features of the model affecting the 
performance of the QA, specifically, the quantum fluctu¬ 
ations strength at the phase transition point, and the di¬ 
verging mass in the quantum kinetic energy which both 
strongly affect the efficiency of quantum tunneling in the 
course of the algorithm. We also find that the trans¬ 
verse field term introduces an additional effective poten¬ 
tial barrier that has to be overcome in the course of the 
algorithm. In that respect it would be interesting to use 
methods developed in this paper to explore QA in mean- 
field models with different types of driver Hamiltonians 
whose ground states are not simple product states where 
ferromagnetic order competes with the transverse (XY) 
ferromagnetism or superfiuity^®^^^. 
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Appendix A: Simulated Annealing 

We discuss the performance of simulated annealing on 
the model, Eq. (1, 4) in the purely classical case of s = 
1, see the rightmost panel in Fig. 1. SA algorithm is 
realized by starting with the infinite temperature limit 
/3 —)■ 0, i.e. equal occupation of all states, and reducing 
the temperature to zero. For simplicity (and without loss 
of generality) we consider an algorithm where /3 changes 
linearly in time from 0 to a very large value with a fixed 
rate v. 

The time it takes to find the ground state with proba¬ 
bility approaching ~ 1, allowing for repeated runs of the 
algorithm is given, as in the quantum case by. 


with magnetization q given by, Qci{q) ~ ~ 

w{(3) reduces exponentially with decreasing 
temperature (growing /?) and therefore, in analogy with 
the quantum case considered in the main text, there ex¬ 
ists a freezing point /? = /3i? in the course of the sweep 
of the inverse temperature where the relaxation time 
~ w~^{j3F) required to achieve thermal distribution be¬ 
comes longer than the length of the algorithm,'!!;”^ (/Jf) ~ 
v~^. After this point the values of the occupation num¬ 
bers of the left Vl and right Vr are effectively frozen. 
Therefore the computation time is determined by two 
quantities calculated at the freezing point, the occupa¬ 
tion of the ground state potential well Vgs = 'Pr{Pf), 
and the relaxation time at the freezing point 


T « e^(.T(qrr.a^)-T(q,r.r^)) g ^ (T( 1) - )) ^ ^ 

where we keep only the main order in the limit N -T 
oo such that VgsIPf) ~ exp(—J'(l))/(exp(—J^(l)) -k 
exp(—iF{qmin)))- The optimal computation time can be 
obtained by minimizing with respect to the inverse tem¬ 
perature at the freezing point, log 2 r) = 0. This 

derivative is discontinuous at the point of the phase tran¬ 
sition Ppt, where ipR — Pp = 0. The computation time 
is an increasing function at Pf > Ppt-, as it is domi¬ 
nated by the decreasing transition rate, the prefactor in 
front of the curly brackets in Eq. (Al). Whereas it can 
be either monotonously decreasing or increasing function 
at/3i? < jfpT depending on the competition between the 
prefactor and the exponents in the brackets in Eq. (Al). 
Therefore the global minimum of t(/3p) corresponds to 
the smallest value out of t{/3pt) and r(0) « 2^, in the 
decreasing and increasing case respectively. The latter 
corresponding to the exhaustive search, i.e. 2^ repeti¬ 
tions of infinitely fast SA. The ground state at g = 1 is 
unique <5(1) « 0 therefore the point of the classical phase 
transition is at Ppt = ■ Therefore the opti¬ 

mal SA computation time corresponds to the smaller of 
the two values. 


r ~ u 1 X VqI. 

Simulated annealing relies on the system reaching ther¬ 
mal equilibrium throughout at least a part of the algo¬ 
rithm. Such that the ground state occupation is given by 
the Gibbs distribution. In problems with a free energy 
barrier separating the initial and the ground state the 
system’s relaxation time is dominated by the over-the- 
barrier escape probability with P{q) = fiE{q) -k Qci{q), 

w(j3) ~ exp {—N {P{q max^ ^ iSlmin ))), 

given by the statistical weight of the escape trajec¬ 
tory^^ where we include the entropy of the classical state 


exp 


N 


Ejq max') Flj^jain) F\( rt 
E{qmia)-E{\) 

2N 


i) + 6Q 


where SQ = Q{qmin) — Q(<lmax)- Note that the entropy 
associated with the metastable state causes a very low 
transition temperature fipp ~ 0(1) and gives rise to an 
additional statistical factor exp(i5(5) slowing down the 
transitions over the barrier. This additional factor ap¬ 
pears as a prefactor in the Kramers rate calculation^"^, in 
the model considered here this factor is exponential and 
needs to be included to correctly describe the scaling of 
the classical transition rate with N. 
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Appendix B: Eigenstates overlap The overlap of this state with the solution of the classical 

problem - state fully polarized along 2 —axis is, 

One of the characteristics associated with complexity 
of a given problem for quantum annealing algorithm is 
the overlap of the eigenstate wave functions at the begin¬ 
ning and the end of the algorithm. We analyze it for our 
model Eqs. (1, 4). The initial state s = 0 is characterized 

by the maximal a;—projection of the total spin, x {N/2 — K\ 0 ) = 


■ 1 ( 

^ N\ 

2N \ 
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